t cH^ decay in the general two Higgs doublet 

model. 



E. O. Iltan * 

Physics Department, Middle East Technical University 

Ankara, Turkey 



Abstract 

We study the flavor changing t cH^ decay in the framework of the general two 
Higgs doublet model, so called model III. Here, we take the Yukawa couplings complex 
and switch on the CP violating effects. We predict the branching ratio six orders larger 
compared to the one calculated in the SM, namely BR ~ 10~^, and observe a measurable 
CP asymmetry, at the order of ~ 10~^. 



*E-mail address: eiltan@heraklit.physics.metu.edu.tr 



1 Introduction 



The top quark reaches great interest since it breaks the SU{2) x f/(l) symmetry maximally and 
it has rich decay products due to its large mass. The rare decays of the top quark have been 
studied in the literature, in the framework of the standard model (SM) and beyond [|I|]-[rU|; the 
one-loop flavor changing transitions t —>■ cg{'-f, Z) in H, M and t —>■ cH^ in 



J' Lll' tj' 



In the SM, these decays are suppressed as a result of Glashow-Iliopoulos- Miaiani (GIM) 



mechanism [jTT|. The branching ratios {BR) of the decays t — > cg{'y,Z) have been predicted 
in the SM as 4 x 10"^^ (5 x 10"^^, 1.3 x 10"^^) in 0. t ^ cH^, which can give strong clues 
about the nature of electroweak symmetry breaking, has been calculated at the order of the 
magnitude of 10~^^ — 10^^^ in the SM, in These are small rates for the measurement, even 
at the highest luminosity accelerators and therefore, there is a need to analyse these rare decays 
in a new physics beyond the SM. 

In the present work, we study the flavor changing t —* cH^ decay in the framework of the 
general two Higgs doublet model (model III), where is the SM Higgs boson. Here, we take 
the Yukawa couplings complex and switch on the CP violating effects. Since the BR is at 
the order of ~ 10"^^ in the SM, we neglect this contribution and calculate the new physics 
effects in the model III. In the calculations, we take into account the interactions due to the 
internal mediating charged Higgs boson and neglect the ones including internal neutral 
Higgs bosons, and (see Discussion part). The numerical results show that the BR of this 
process can reach to the values of order 10^^, playing with the free parameters of the model HI, 
respecting the existing experimental restrictions. This prediction is almost seven orders larger 
compared to the one in the SM and it is a measurable quantity in the accelerators. 

Furthermore, we predict the possible CP asymmetry Aqp at the order of 10~^ for the 
intermediate values of the CP parameter, due to the complex Yukawa coupling ^^^f, (see section 
2 for its definition). This is purely a new physics effect and the measurement of Acp for the 
process under consideration may open a new window to go beyond the SM and test the new 
physics. 

The paper is organized as follows: In Section 2, we present the BR and Acp of the decay 
t cH^ in the framework of model HI. Section 3 is devoted to discussion and our conclusions. 
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2 The Flavor changing t cH^ decay in the framework 
of the general two Higgs Doublet model 

The flavor changing transition t cH^ is quite suppressed in the SM due to the Glashow- 



Ihopoulos-Maiani (GIM) mechanism [|T^. The extended Higgs sector could bring large contri- 
butions to this decay and make CP violation possible, in general. This section is devoted to 
the calculation of the BR and the CP violating asymmetry of the decay under consideration, in 
the general two Higgs doublet model, so called model HI. In the model III, the flavor changing 
neutral currents in the tree level are permitted and various new parameters, such as Yukawa 
couplings, masses of new Higgs bosons, exist. 

The t — > cH^ process is controlled by the Yukawa interaction and in the model HI, it reads 



as 



= Vi^jQiL4>lUjR + r]f'QiL(t>lDjR + ^ijQiL4>2UjR + i^jQiL4'2DjR + h.c. 



(1) 



where L and R denote chiral projections L{R) = 1/2(1 =i= 75), 0, for i = 1,2, are the two scalar 
doublets, QiL are left handed quark doublets, UjR^Djji) are right handed up (down) quark 
singlets, with family indices The Yukawa matrices rjfj^ and ^^j^ have in general complex 
entries. It is possible to collect SM particles in the first doublet and new particles in the second 
one by choosing the parametrization for (pi and 02 as 



1 

V2 







_}_( V2H+ 



(2) 



with the vacuum expectation values. 



1 ^0 



< 02 >= 



(3) 



Here, Hi and H2 are the mass eigenstates and respectively since no mixing occurs between 
two CP-even neutral bosons and at tree level, for our choice. 
The Flavor Changing (FC) interaction can be obtained as 



where the couplings ^^'^ for the FC charged interactions are 



(4) 



idi - VCKM ) 



(5) 
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and ^^'^ is defined by the expression 

(T' = . (6) 

Here the index "N" in ^^'^ denotes the word "neutral". 

The SM contribution to the BR of the process t cH^ is neghgibly small, which is at the 
order of the magnitude 10^^^. Therefore, we take into account only the new effects beyond 
the SM. The relevant diagrams are given in Fig |^. At this stage, we would like to discuss the 
possibilities not to take into account the tree level contribution to the decay underconsideration, 
in the model III. First, it can be assumed that all the off diagonal neutral Yukawa couplings 
vanish and therefore the coupling Sjjqtc vanishes. Another possibility is to take the mixing 
between two neutral Higgs bosons and hP is small and the tree level interaction t — c — 
is negligible. In our case, we consider the gauge and CP invariant Higgs potential which 
spontaneously breaks SU{2) x f/(l) down to U{1) as: 

y(0i,02) = Ci(0+0i-t;V2)2 + C2(0+02)' 

+ +Cs[{<Pt<Pl - + <Pt<p2? + C4[(0+0l)(0+02) - (0|02)(0^0l)] 

+ C5[/?e(0+02)]' + C6[/m(0+02)]' + C7 . (7) 

Since we assume that only 0i has vacuum expectation value, no mixing occurs between two 
neutral Higgs bosons and the tree level interaction vanishes. Furthermore, since we take the 
c-quark mass zero and the coupling ^'^^^ negligible compared to the couplings ^^^^ and C,N,bb 
(see ||l2|), the main contribution comes from the diagrams with internal charged Higgs boson 
and for the matrix element, we get 

M{t ^ ci/°) = -tV^b V;. ^ ^ + c (1 + 75) t , (8) 

where 

= m,e^,,,e^,;/3, (9) 
and the functions /i, /2, /s are defined as 



1-^, L Zt{-1 + X + y) {y + xzt) Z/w (2 - 



A = I dx I dy\l + ^'' . , ^, ,,,, , . -f^'^ +2/n(x + ^(x,y)) , 

Jo Jo [ x + g{x,y) l — x + g{x,y) J 

, f'-\ ywi-l + x + y) 

/2 = dx dy ■ — r ^ , 

Jo Jo l — x + g{x,y) 

h = l^J!^^±Ji!^, (10) 

1-2/6 



with g{x,y) =( -1 + x + (xyt + yzt). Here yt = mj/mjj±, Zt = mjjo/mjj±, yw = ml^/m]j± 
and yh = ml/mjj±. Using the eq. (|]), it is straightforward to obtain the decay width as 

r(t ^ cH^) = ^ IMP . (11) 

^ ^ 327r mtyt ' ' ^ ^ 



Now we would hke to give the expression for Acp of the above process. Here, we take C,^ 



NM 



and complex with the parametrizations 



SAr,tt — \'iN,tt \ ^ 5 

^N,bb — \^N,bb\ ; (12) 

and assume that the complexity of ^^^^ is small. Using the definition of the CP violating 

asymmetry Aqp 

_ Y{t^cH^)-Tit^-cH') 



we get 



AcP = \^%,u\stn{etb-eu)- , (14) 



where 



D = "^yw \ilbb\ \f2? + 2 Reih n - fs f2)cos{9tb - Ou) , (15) 
and the functions /i, /2 and /s are given in eq. (p!0|) . Here the symbol * denotes the complex 



conjugation. As it is shown from the eq. (14), Aqp vanishes when two CP violating angles Qtb 
and Qtt are equal. This is interesting, since Acp can vanish even in the existence of complex 
phases, in the model HI. 



3 Discussion 

In this section, we study the sinOtb, mno and ^^,bb dependencies of the BR and Acp for the 
process t cH^, in the model HI. For the calculation of the BR we take the value of the total 
decay width ~ T(t bW) as Tt = 1.55 GeV. Notice that the coupling ^§bb defined as 

The process t cH^ exists also in the SM and model II (or I) version of the 2HDM. In both 
models this process appears at least at loop level. In the SM model internal mediating 
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bosons are responsible for this decay and its BR is very small, at the order of the magnitude 
of 10~^^. In the model II, additional contribution comes from the charged Higgs boson H"^ 
and can be enhanced compared to the SM result by playing with the free parameter tanf3, 
respecting the experimental measurements. However, no Aqp occurs in the model II (I) and 
also in the SM. This forces one to go into the model III, with complex and possibly large 
Yukawa couplings. 

Model III contains large number of free parameters such as Yukawa couplings, the 
masses of new Higgs bosons, H^, and , and they should be restricted by using experimental 
measurements. At this stage we summarize these restrictions: 

• We neglect all the Yukawa couplings except ^Yitt ^^^1 i^bb since they are negligible due to 
their light flavor contents, by our assumption. Notice that we also neglect the off diogonal 
coupling i^tc, since it is smaller compared to i^tt (see [ll2|)- Therefore, the new neutral 



Higgs bosons do not have any contribution to the BR of the decay under consideration. 
We take ^Yitt i^bb complex and respect the constraint for the angle 6tt and O^b, due to 



the experimental upper limit of neutron electric dipole moment, < 10 ^^e-cm, which 
leads to ^Jm{i%i%%) < 1.0 for Mh± ~ 200 GeV [g. 

We find a constraint region for these free parameters by restricting the Wilson coefficient 
C^^^ , which is the effective coefficient of the operator 0^ = Y^Sa<yfj.u{'m'bR + ^sL)baJ^^'^ 
(see 



12] and references therein), in the region 0.257 < \Cj^^\ < 0.439. Here upper and 
lower limits were calculated using the CLEO measurement [p!^ 

BR{B X,7) = (3.15 ± 0.35 ± 0.32) 10"^ . (16) 



and all possible uncertainities in the calculation of Cy-^-^ ||T2|. 

For completeness we present the Wilson coefficient C^^^ . Denoting the contribution for the 
SM with Cj^'^{mw) and the additional charged Higgs contribution with C^{mw), we have the 
initial values 

"^t ^ts ^tb 

+ (^X. + Cn%^) i^N,bb + ^N,sb^)F2{yt) . (17) 

T^t^^b Vts ^tb 

The LO corrected coefficient Cj^^^^lfi) is given as 

+ C2^™^(m^)^M'^' , (18) 

i=l 



and ?7 = as{mY/) / aa{jj), hi and are the numbers which appear during the evaluation [15 
The exphcit forms of the functions -Fi(2)(y) are, 

y(%-3) y(-% + 2) 

^^^^^ ^ T%^ + ^(^^^^^- 

The discussion given above allows us to obtain a constraint region for the couplings iYitu 
C,Nbb ^^"^ C^P violating parameters, sinOu and sinOtb- Here, we assume that the coupling 
has a small imaginary part and we choose \rti,\ = |t5^| < 1. Notice that, in figures, the 
BR is restricted in the region between solid (dashed) lines for C^^^ > (Cy-^-^ < 0). Here, there 
are two possible solutions for C^^^ due to the cases where \rtb\ < 1 and rtt > 1. In the case of 
complex Yukawa couplings, only the solutions obeying \rtb\ < 1 exist. 

In Fig. 0, we plot the BR with respect to sinOtb for sinOu = 0.1, = 400 GeV, 

mijo = 120 GeV, C,Nbb — 10 wi;,. As shown in this figure, the BR can reach to the values at 
the order of the magnitude of 10~^ and it is not so much sensitive to the parameter sin 9tb- Its 
magnitude is almost 30% larger for Cj^^ > compared to the one for Cj" < 0. 

Fig. H represents the BR with respect to \^§bb\ for sinOu = 0.1, sinOtb = 0.5, mH± = 
400 GeV and muo = 120 GeV. This figure shows that the BR is strongly sensitive to the the 
coupling \^§i,f,\ and it can get the values at the order of 10~^ even for = 20 m^,. This 

observation is an important clue about the upper limit of the coupling with the possible 

future measurement of the BR. For the small coupling IC^^^I' restricted region for the BR 
becomes narrow, for both C^" > and C^^^ < 0. 

Finally, we show the rriHO dependence of the BR in Fig. ^ for sinOu = 0.1, sinOtb = 0.5, 
mH± = 400 Gey and = 10 m;,. With the increasing values of m/^-o, the BR decreases and 

the restriction region becomes narrower. 

At this stage, we would like to analyse the CP asymmetry Acp of the decay t —>■ cH^ and 
show sinOtb and mno dependencies of Acp in the figures |^ and ^, respectively. Acp is at the 
order of the magnitude of 10^^ for the intermeditate values of sin Otb and it can reach to 7 x 10^^ 
for C7^^ > 0. Notice that sinOtt is taken small and Acp vanishes when two CP parameters 
have the same values, namely sinOtb = sinOtt- If Acp is positive (negative), C^^^ can have 
both signs. However, if it is negative, C^^^ must be negative. This observation is useful in the 
determination of the sign ofC^-^^. The same behaviour is observed in Fig. ^ which represents 
the mass niHO dependence of Ac p. When the Higgs mass increases, an enhancement in 
Acp is detected, especially for Cj^^ > 0. 
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Now we will summarize our results: 

• The BR of the flavor changing process t cH^ is at the order of 10^^^ in the SM and the 
extended Higgs sector brings large contributions, at the order of 10^'' — 10~^, which can 
be measured in the future experiments. This ensures a crucial test for the new physics 
beyond the SM. 

• The BR is sensitive to l^^^^l and its measurement makes it possible to predict an upper 
limit for this coupling. Furthermore, the measurement of the BR of the decay under 
consideration can give important information about the mass of Higgs boson H^. 

• Acp is at the order of the magnitude of 10~^ for the intermeditate values of sinOth and it 
rises up to the values 7 x 10^^ for Cj^^ > 0. The measurement of Acp can ensure a hint 
for the determination the sign of C^"^^ . 

Therefore, the experimental investigation of the process t — >■ cH'^ will be effective for un- 
derstanding the physics beyond the SM. 
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Figure 1: One loop diagrams contribute to the decay t cH^ due to internal charged Higgs 
boson. Wavy line represents the if ° field and dashed line the field. 
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Figure 2: BR{t cH^) as a function of sinOfb for If^jf,! = 10 7715, mfj± = 400 GeV, tjiuq = 
120 GeV, sinOtt = 0.1 in the model III. Here the BR is restricted in the region bounded by 
sohd hues for C^^^ > and by dashed hues for Cj-^-^ < 
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Figure 3: BR{t — > ci?°) as a function of |^^(,{,| for sinOu — 0.1, sinOtb — 0.5, m^± = AOOGeV, 
rriH" = 120 GeV" in the model III. Here the BR is restricted in the region bounded by sohd 
hues for C^^^ > and by dashed hues for C^^^ < 




Figure 4: BR(t — ^ ciJ^) as a function of uiho for If^^f,! = 10 mt, sinOu = 0.1, sinOtb = 0.5, 
mH± = AQQGeV in the model 111. Here the BR is restricted in the region bounded by solid 
lines for C^^^ > and by dashed lines for C^^^ < 
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Figure 5: The same as Fig. ||, but for Acp- 
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Figure 6: The same as Fig. ^, but for Acp. 
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